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We  consider  a  series  of  n  single-server  queues,  each  with  unlimited  waiting  space  and  the 
firsc-in  first-out  service  discipline.  Initially,  the  system  is  empty:  then  k„  customers  are  placed 
in  the  first  queue.  The  service  times  of  all  the  customers  at  all  the  queues  are  i.i.d.  with  a 
general  distribution.  We  show,  under  appropriate  conditions,  that  the  departure  process  from 
the  n*  queue  satisfies  an  invariance  principle,  converging  as  n  —  after  normalization  to  a 
reflected  Brownian  motion  (RBM).  As  a  consequence,  the  first  k  interdeparcure  times  from 
queue  n  after  the  first  departure  are  of  order  V*  as  n  -*  «.  Moreover,  we  establish  a  strong 
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after  the  first  departure  is  of  order  for  0  S  a  <  1  and  x  >  0.  Finally,  we  apply  the 

subadditive  ergodic  theorem  again  to  establish  a  hydrodynamic  limit;  i.e..  we  show  that  the 
average  of  the  first  UnJ  interdeparture  time  from  queue  n  converges  almost  surely  to  a  finite 
limit  as  «  — *  »  for  each  s  >  0. 

AMS  1980  subject  classifications,  primary  60K25.  60F17;  secondary  90B22.  60J60. 

Key  words  and  phrases,  tandem  queues,  queues  in  series,  queueing  networks,  departure 
process,  transient  behavior,  reflected  Brownian  motion,  limit  theorems,  invariance  principle, 
strong  approximation,  subadditive  ergodic  theorem.  Urge  deviations,  interacting  particle 
systems,  hydrodynamic  limit. 

'Research  supported  by  the  U.S.  Army  Research  Office  under  Contract  DAAL-03-88-K-0063. 


i 


1 


1.  Introduction  and  Summary 

In  this  paper  we  consider  a  queueing  model  that  could  be  used  to  represent  the  start-up 
behavior  of  a  long  production  line  or  the  transient  flow  of  messages  over  a  long  path  in  a 
communication  network.  In  particular,  we  consider  a  series  of  n  single-server  queues,  each 
with  unlimited  waiting  space  and  the  first-in  first-out  service  discipline.  Initially,  the  system  is 
empty;  then  kn  customers  arc  placed  in  the  first  queue.  'Hie  service  times  of  all  the  customers 
at  all  the  queues  are  i.i.d.  with  a  general  distribution  having  mean  1  and  finite  positive 
variance  a2.  Our  object  is  to  describe  the  departure  process  from  the  n*  queue  as  n  gets  large. 
(Equivalently,  since  customers  are  served  in  order  of  arrival,  we  can  consider  infinitely  many 
queues  in  series  with  infinitely  many  customers  in  the  first  queue;  we  are  still  interested  in  the 
departure  times  of  the  first  kH  customers  from  the  n 111  queue  as  n  — >  <*>.)  We  may  have  kn 
constant,  independent  of  n,  or  kn  —>  »  as  n  -»  oo. 

Let  D(k,  n)  be  the  departure  time  of  customer  k  from  queue  n.  Let  =>  denote 
convergence  in  distribution  or  weak  convergence,  as  in  Billingsley  (1968).  Since  D(l,  n)  is 
just  the  sum  of  n  service  times, 

/T*[D(1,  n)  -  n]  =>  iV(0,  o2)  as  n  -»  oo  ,  (1.1) 

where  N(m,  a2)  denotes  a  normal  random  variable  with  mean  m  and  variance  a2.  However, 
we  are  primarily  interested  in  the  interdeparture  times  between  successive  customers  after  the 
first  from  queue  n.  Let  D(k,  n )  be  the  average  of  the  first  k  interdeparture  times  from  queue  n 
after  the  first  departure,  i.e., 

D(k,  n)  =  [D{k  +  1,  n)  -  D(  1,  n))/k  .  (1.?) 

Let  UJ  denote  the  integer  part  of  x.  Here  is  what  we  regard  as  our  main  result. 

Theorem  1.1.  Suppose  that  the  service  times  are  i.i.d.  with  a  general  distribution  having  an 
exponential  tail.  Then,  for  x  >  0  and  0  £  a  <,  1,  there  exists  a  proper  random  variable  La(x) 
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SUCh  that 

n"(i'a)/2D(Lt«aJ,  n)  =>  as  n  -»  *  .  (1.3) 

Theorem  1.1  implies  that  the  average  of  the  first  LtnaJ  interdeparture  times  from  queue  n 
after  the  first  departure  is  asymptotically  of  order  n(1_a)/2  as  n  increases.  A  statement  in  terms 
of  the  departure  times  that  can  be  shown  to  be  equivalent  to  (1.3)  is 

n-(1+a)/2(D(U«flJ,  n)  -  n]  =s>  L'a{x)  as  n  -»  »  ,  (1.4) 

where  L'a(x)  =  x  La(x)  for  0  <  a  £  1.  (The  relationship  between  L'0(x)  and  L0(x)  is  more 
complicated.) 

Our  primary  focus  is  on  the  early  departures  from  a  large  number  of  queues.  For  example, 
the  customer  index  k„  associated  with  n  queues  might  be  k,  'Tn  or  n.  However,  there  is  a 
duality  discussed  in  Section  2  that  makes  our  results  also  applicable  to  a  large  number  of 
departures  from  relatively  few  queues.  In  particular,  under  our  i.i.d.  assumption  for  the  service 
times, 

d 

{D(i,  j)  :  1  S  i  S  1,1  <  ;  S  «}  =  (D(y,  i)  :  l  *  j  Z  n,  l  £  i  &  k}  (1.5) 

d 

where  =  denotes  equality  in  distribution.  Hence,  associated  with  (1.3)  and  (1.4)  are  dual 
statements  about  the  departure  time  of  customer  n  from  queue  kn.  For  example,  as  a 
consequence  of  (1.4),  we  obtain  the  following  corollary. 

Corollary.  Under  the  conditions  of  Theorem  1.1,  there  exists  a  proper  random  variable  L^{x) 
such  that 

n-0+*)'i(D(lxna},  n)  -  lxnaJ)  =>  L*(x )  as  n  -»  ~  (1.6) 


for  x  >  0  and  a  >  1,  where 


(1.7) 
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L*(x)  =  x-V+a),2L'a->(x-Ua)  . 

so  that 

D(\jcna\,  n)/\_xna\  =>  1  as  n  — »  »  .  (1.8) 

Three  rather  distinct  cases  are  combined  in  Theorem  1.1:  (i)  a  =  0,  (ii)  0  <  a  <  1  and 
(iii)  a  =  1.  We  treat  the  first  case  with  a  =  0  by  establishing  a  functional  central  limit 
theorem  (FCLT)  for  the  departure  process  from  queue  n  (Theorem  3.2);  we  treat  the  second 
case  0  <  a  <  1  by  establishing  a  strong  approximation  generalization  of  the  FCLT  and 
applying  the  subadditive  ergodic  theorem  as  on  p.  277  of  Liggett  (1985)  to  the  limiting  RBM 
(Theorem  7.2);  we  treat  the  third  case  by  directly  applying  the  subadditive  ergodic  theorem 
(Theorem  6.3).  In  the  first  case  with  a  =  0,  La(x)  is  a  nondegenerate  random  variable,  but  in 
the  other  two  cases  La(x)  is  deterministic.  In  the  third  case  with  a  =  1,  we  establish  almost 
sure  convergence.  Unfortunately,  we  do  not  yet  know  much  about  the  limits  in  (1.3),  (1.4)  and 
(1.6).  For  a  <  1,  the  limit  La(x)  depends  on  the  service-time  distribution  only  through  its 
first  two  moments.  For  a  =  1,  we  conjecture  that  La(x)  depends  on  the  service-time 
distribution  beyond  its  first  two  moments. 

This  paper  was  largely  motivated  by  Srinivasan  (1989),  who  applied  results  of  Rost  (1981), 
Andjel  (1982),  Andjel  and  Kipnis  (1984),  Kipnis  (1986),  and  Benassi  and  Fouque  (1987)  about 
interacting  particle  systems  (in  particular,  the  zero-range  process  and  the  asymmetric  simple 
exclusion  process)  to  describe  the  hydrodynamic  limit  for  our  model  in  the  special  case  of 
exponential  service  times  (still  with  mean  1).  Roughly  speaking,  the  hydrodynamic  limit  says 
that  the  average  queue  length  among  the  first  [ xt ]  queues  at  time  t  is  asymptotically  almost 
surely  (a.s )  equal  to  (2  -  Vx)/Vx  as  t  -»  «.  Consequently,  the  average  queue  length 
among  queues  in  the  neighborhood  of  queue  [xr]  is  asymptotically  a.s.  (1  -  Vx)/V*  as 
t  — »  oo.  (Note  that  the  total  number  of  customers  in  the  first  Led  queues  is 
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(2^7  -  x)t  +  o(t );  then  differentiate  with  respect  to  x.  In  the  unsaturated  case  with  external 
arrival  process  having  rate  X  <  1,  asymptotically  a.s.  the  first  (1  -  X)2t  queues  reach 
equilibrium  at  time  t  as  /  -*  oo,  but  the  rest  of  the  density  profile  remains  the  same.) 

It  is  easy  to  apply  Srinivasan’s  hydrodynamic  limit  in  the  saturated  case  (with  i.i.d. 
exponential  service  times  having  mean  1)  to  deduce  that  the  departure  time  of  customer  LtnJ 
from  queue  n  is  asymptotically  a.s.  (1  +  V7)2n  +  o(n);  see  Section  6.  Thus  the  departure 
times  of  customers  1  and  n  from  queue  n  are  a.s.  n  +  o(n)  and  4 n  +  o(n),  respectively.  To 
put  this  result  in  perspective,  if  customer  n  only  had  to  wait  at  the  first  queue  (as  would  be  the 
case  if  all  queues  after  the  first  had  infinitely  many  servers),  then  the  departure  time  for 
customer  n  from  queue  n  would  be  a.s.  2 n  +  o(n).  Hence,  the  additional  delay  experienced  by 
customer  n  in  the  last  n  -  1  queues  is  approximately  equal  to  his  delay  in  the  first  queue  plus 
the  sum  of  his  service  times. 

Our  case  (iii)  of  Theorem  1.1  with  a  =  1  extends  Srinivasan  (1989)  by  establishing  a 
hydrodynamic  limit  for  general  service-time  distributions.  As  suggested  by  the  discussion 
above,  limits  for  the  average  queue  length  among  the  first  Lx rj  queues  at  time  t  as  t  -*  ~  are 
equivalent  to  limits  for  n~l  D(  Ixn] ,  n)  as  n  -*  «o,  so  case  (iii)  of  Theorem  1.1  yields  a 
hydrodynamic  limit  in  the  sense  of  Srinivasan  (1989)  for  general  service-time  distributions. 
With  regard  to  the  interacting  particle  system  literature,  our  result  is  interesting  because  the 
associated  vector  queue-length  process  depicting  the  number  of  customers  at  each  queue 
(including  the  one  in  service,  if  any)  is  not  Markov  here.  We  treat  this  case  by  applying  the 
subadditive  ergodic  theorem  together  with  an  upper  bound  based  on  a  stochastic  comparison 
involving  associated  random  variables  and  the  Cramer  (1938)-Chemoff  (1952)  theorem  about 
large  deviations,  e.g.,  see  Vanderbei  and  Weiss  (1988)  or  pp.  3.7  of  Varadhan  (1984). 
However,  we  have  not  yet  identified  the  limit  for  general  service-time  distributions. 
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We  also  complement  Srinivasan  (1989)  by  describing  in  more  detail  what  happens  at  the 
front  of  the  "wave”  of  customers  passing  through  the  network.  Of  course,  the  first  customer 
departs  from  queue  n  at  time  n  with  a  deviation  of  order  V/T,  as  indicated  in  (1.1).  The  first 
case  of  Theorem  1.1  with  a  =  0  reveals  that  the  first  k  interdeparture  times  from  queue  n  after 
the  first  departure  are  each  asymptotically  of  order  'fn  as  n  — >  «>.  Consequently,  by  the  time 
customer  k  has  reached  queue  n  for  large  n,  customer  k  rarely  has  to  wait.  We  treat  this  case 
by  showing  under  appropriate  conditions,  that  the  departure  process  from  the  /Ith  queue  obeys 
an  invariance  principle  or  functional  central  limit  theorem  (FCLT).  The  FCLT  supports 
approximating  the  beginning  of  the  departure  process,  after  appropriate  normalization,  by  an 
infinite-dimensional  reflected  Brownian  motion  (RBM)  on  the  infinite-dimensional  orthant 
[0,  «.)**.  This  infinite-dimensional  RBM  is  the  natural  extension  of  finite-dimensional  RBMs 
considered  by  Harrison  (1978),  Harrison  and  Reiman  (1981a,b),  Reiman  (1984)  and  Harrison 
and  Williams  (1987a,b). 

The  invariance  principle  implies  that  the  approximation  depends  on  the  service-time 
distribution  only  through  its  mean  and  variance.  Moreover,  the  mean  and  variance  play  a 
relatively  trivial  role.  In  particular,  the  mean  service  time  only  determines  the  deterministic 
rate  customers  flow  through  the  queues;  without  loss  of  generality,  we  can  let  the  mean  service 
time  be  one,  and  we  do.  The  service-time  variance  only  appears  (via  its  square  root)  as  a 
constant  multiplicative  factor  in  front  of  the  multivariate  RBM  associated  with  service-time 
variance  1.  Hence,  just  as  with  the  familiar  one-dimensional  Brownian  motion  (BM) 
approximation  for  partial  sums  of  i.i.d.  real-valued  random  variables,  there  is  essentially  only 
one  fundamental  limit  process  for  this  system  for  all  service-time  distributions.  We  call  this 
limit  process  the  departure  RBM. 

The  model  we  consider  has  no  external  arrival  process,  but  the  s-..e  model  can  be 
interpreted  as  starting  out  empty  with  an  external  arrival  process.  Simply  interpret  the 
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departure  process  from  the  first  queue  as  the  external  arrival  process.  Of  course,  the 
assumption  that  the  service  times  be  all  i.i.d.  implies  that  the  interarrival-time  distribution  must 
then  be  exactly  the  same  as  each  service-time  distribution.  However,  this  is  not  required  for 
the  FCLT.  The  FCLT  remains  unchanged  if  the  service-time  distributions  at  an  initial  finite  set 
of  queues  are  different  (The  stated  results  cover  this  generalization.) 

To  obtain  further  insight  into  the  first  appearance  of  congestion,  we  establish  a  strong 

approximation  that  shows  that  the  error  in  the  RBM  approximation  for  the  first  LxnaJ 

customers  is  0(n(a  ~  log  n).  We  also  show  that  the  error  in  the  RBM  approximation  is 

asymptotically  negligible  compared  to  the  size  of  the  first  btnaJ  components  of  the  RBM.  To 

obtain  this  result  we  also  need  to  describe  how  the  components  of  the  departure  RBM  grow. 
^  , 

Let  D  k{  1)  denote  the  coordinate  of  the  departure  RBM  at  time  1.  We  apply  the 
subadditivc  ergodic  theorem  again  to  show  that 

k~'ADk(\)  =>  Lt(l)  as  k  ■»  (1.9) 

for  Li(l)  in  (1.3);  see  Theorem  7.1.  We  thus  obtain  Theorem  1.1  for  0  <  a  <  1;  see 
Theorem  7.2. 

The  rest  of  this  paper  is  organized  as  follows.  Li  Section  2  wc  review  a  convenient 
representation  for  the  departure  process  that  facilitates  its  study.  In  particular,  we  exploit  the 
fact  that  the  departure  time  of  customer  k  from  queue  n  can  be  represented  as  the  maximum 
partial  sum  of  service  times  along  nondecreasing  paths  of  length  k  +  n  -  1  in  a  kx  n  lattice  of 
service  times.  From  this  representation,  the  duality  mentioned  above  is  immediate. 

In  Section  3  we  establish  the  FCLT  and  in  Section  4  we  establish  the  strong  approximation 
needed  for  case  (ii)  of  Theorem  LI  with  0  <  a  <  1.  In  Section  5  we  establish  stochastic 
order  relations  among  the  interdeparture  times,  which  are  of  interest  in  their  own  right,  but  also 
help  us  describe  the  departure  RBM  and  treat  the  case  kn  =  0(n )  in  Section  6.  In  Section  6 
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we  obtain  our  hydrodynamic  limit,  i.e.,  we  treat  the  case  kn  =  LtnJ.  In  Section  7  we 
establish  (1.9)  and  the  third  case  of  Theorem  1.1.  Finally,  in  Section  8  we  make  some 
concluding  remarks. 

We  end  this  introduction  by  mentioning  some  additional  references  that  provide  background 
or  treat  somewhat  related  problems:  Chapter  6  of  Disney  and  Kiessler  (1987),  Kelly  (1982, 
1984),  Suresh  and  Whitt  (1990)  and  Vere-Jones  (1968). 


2.  The  Basic  Recursion  for  the  Departure  Epochs 

Let  V(k,  n)  be  the  service  time  and  D(k,  rt)  the  departure  time  for  customer  k  at  queue  n. 
Our  starting  point  is  a  basic  recursion  for  the  departure  times, 

D(k.  n )  =  max{D(k  -  1),  n) ,  D(k,  n  -  1)}  +  V{k,  n)  (2.1) 

for  k  2  1  and  n  2  1,  with  D(Jt,  0)  =  0  for  all  k  and  D(0,  n)  -  0  for  all  n,  which  can  be 
taken  as  the  definition.  (At  this  point,  we  do  not  assume  that  the  service  times  are  i.i.d.) 


We  can  easily  express  D(k,  n )  more  directly  in  terms  of  the  service  times.  To  do  so,  let 
n(k,  n)  be  the  set  of  all  “nondecreasing  continuous  paths”  of  length  k  +  n  —  1  from  (1,1)  to 
(k,  n)  in  the  set  of  ordered  pairs  2?  a  { (i ,  ;')  :  1  <  i  S  k,  1  £  j  £  n};  i.e.,  Jt  €  n(/t,  n)  if  rt 
is  a  subset  of  2?  of  cardinality  k  +  n  -  1  containing  (1,1)  and  either  (i  +  1,  j)  or  (i,  j  +  1), 
but  not  both,  whenever  it  contains  (i,  j).  Since  successive  ordered  pairs  in  any  such  path  rt 


increase  in  the  first  component  exactly  k  -  1  times,  there  are 


k  +  n  -  2 
k  -  ! 


paths  in  n(/t,  n). 


From  (2.1),  we  easily  establish  the  following  by  induction. 


Proposition  2.1  For  all  it  >  1  and  n  >  1, 


(2.2) 
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D(k,  n) 


max  {D(k  -  1 ,  /)  +  T  V(k,  /)} 

ls,i"  ,=/ 


max  {D(l,  n  -  1)  +  £  V(i,  *)} 


is  /  s  * 


i=i 


max  {  X  ^O'. ))} 

Jt  €  n<*,  «)  y)  g  Jt 


(2.3) 

(2.4) 


Evidently  Proposition  2.1  is  quite  well  known;  e.g.,  formulas  (2.1)  and  (2.3)  appear  as  (1), 
(2)  and  (16)  of  Tembe  and  Wolff  (1974).  A  variant  of  (2.4)  for  queues  without  extra  waiting 
space  appears  in  Muth  (1979).  As  Muth  observes,  (2.4)  implies  that  the  departure  times 
D(k,  n )  are  unchanged  if  we  reverse  the  order  of  the  queues  and  the  order  of  the  service  times 
at  each  queue.  Let  superscripts  index  different  models. 

Corollary  1.  If  V2(i,  j)  =  V]  (k  -  i,  n  -  j)  for  1  S  i  £  k,  1  S  ;  S  n,  then 
D2  {k,  n)  =  D1  (k,  n). 

d 

Formula  (2.4)  also  implies  a  certain  duality,  i.e.,  symmetry  in  k  and  n.  Let  =  denote 
equality  in  distribution. 

d 

Corollary  2.  If  {V'(i,  j)  :  \  <  i  <  k,  1  S  j  Z  n}  =  { V2(j ,  i)  :  1  £  i  S  it,  l  <,  j  <,  n}, 
then 

d 

{D 1  (i,  j)  :  1  £  i  £  k,  1  <  j  £  n}  =  { D2(j,i )  :  1  £  /  £  *,  1  <;  j  £  n}  . 


As  an  immediate  consequence  of  Corollary  2,  we  obtain  the  following  result  in  the  i.i.d. 
setting  which  is  of  primary  interest  to  us. 

Corollary  3.  If  V(i,  j),  l  £  i  £  k,  1  S  j  S  n,  are  i.i.d.,  then  (1.5)  holds. 

Corollaries  2  and  3  can  be  used  to  obtain  limit  theorems  as  k  — »  <»  for  fixed  n  from  the 
limit  theorems  we  establish  as  n  »  for  fixed  k.  Corollaries  2  and  3  also  allow  us  to  relate 

the  interdeparture  times  of  primary  interest  to  us  to  associated  sojourn  times.  The  k ^ 
interdeparture  time  from  queue  n  is 
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A(k,  n)  =  D(k  +  1,  n)  —  D(k,  n)  (2.5) 

with  D(0,  n)  =  0,  for  k  >  0  and  n  >  1.  The  sojourn  time  of  customer  k  at  queue  n  is 

S(k,  n )  =  D(k,  n)  -  D(k,  n  -  1)  .  (2.6) 

Corollary  4.  Under  the  assumption  of  Corollary  3, 

d 

{A O',  j)  :  0  <  i  <  k  -  1,  1  £  j  <  n}  =  S(j,  i )  :  \  <,  j  <,  n,  \  <,  i  <,  k)  (2.7) 

Remarks.  (2.1)  Corollaries  3  and  4  immediately  provide  an  analog  of  Theorem  1.1  for  the 
average  sojourn  time  of  the  first  n  customers  from  the  first  LmaJ  queues  after  the  first  queue. 

(2.2)  The  function  mapping  {V(i,  j)  :  1  £  i  ^  k,  1  £  j  £  n}  into  { D(i ,  j)  :  \  <>  i  <  k, 
1  <  j  <  n}  is  obviously  nondecreasing  and  convex,  so  that  stochastic  order  relations  for 
service  times  carry  over  to  departure  times;  see  Stoyan  (1°83).  The  function  is  also  Lipschitz, 
i.e.,  for  each  path  it 

Z  Z  v2v,j)\s  z  ) 

0.  j)  €  K  (*.  J)e  n  I  («,  j)  e  k 

and 


max  { 
is  >  s  * 
l  s  j  s  « 


f52(«.7) 


S  (*  +  «  -  1) 


max  {!Vl(j,»  -  V2(i,  ;')|} 
i  s  ;  s  * 

1  S  y  S  >i 


so  that  there  is  model  stability;  see  Whitt  (1974). 


3.  The  Functional  Central  Limit  Theorem 

We  now  apply  (2.2)  to  show  that  {D(k,  /»)}  satisfies  a  FCLT  as  n  ->  ~  when  {V(k,  «)} 
does.  (We  do  not  assume  that  {V(it,  n)}  is  i.i.d.  here.)  For  this  purpose,  let  £>[0,  «>)  be  the 
space  of  right-continuous  real-valued  functions  on  the  interval  [0,  <»)  with  limits  from  the  left, 
endowed  with  the  usual  Skorohod  (1956)  J\  topology;  see  Ethier  and  Kurtz  (1986)  or 
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Whitt  (1980).  Let  Z)[0,  oo  )“  be  the  product  space  endowed  with  the  product  topology. 
Let  Vn  and  Dn  be  random  elements  of  D[0,  «)~  defined  as  follows: 


V*  =  (Vu,  V2n,...) 

Dn  —  (.Din,  Din*  -  ) 


Vk„(t)  =  n~a  £  V(k,j)  -  nt  ,  r  >  0  , 


Dkn(t)  =  n~a(D(k,  [nr])  -  nt)  .  t  2>  0  . 


(3.1) 


for  a  >  0. 

A  A 

Theorem  3.1.  If  V„  =>  V  in  D[0,  oo)**  as  n  — »  oo  where  V  has  continuous  paths  w.p.l,  then 
D„  D  in  D[0,  <»)“  as  n  — »  oo,  where  D  =  f(V)  with  /  :  D[0,  oo)**  — >  D[0,  oo)“ 
defined  by 

fi(x)(t)  ~  Xi(t ) 
and 

fk(x)(t)  =  sup  (/*-i(J)  +  xk(t)  -  xk(s)}  (3.2) 

o  s  s  s  I 

=  xk(t)  -  inf  {xk(s)  -  /t_i(j)} 

0  5  s  £  I 

for  all  k  £  2  and  r  £  0. 

Proof.  First,  from  (2.2)  and  (3.1)  it  is  immediate  that  D\n  -  V\H •  Next, 


Dknit)  =  n~a(D(k,  [nr]  -  nt) 

l«l 

max  {D(k- l.l)  +  £  V(k,j)}  -  nt 

l  £  t  £  [nt] 

M 

sup  (D(k  -  I,  [ns])  -  ns  +  £  K(*.  ;')  -  n(r  -  s) } 
®  s  s  *  >■(«] 

=  sup  {£>*_!,„(*)  +  Vnt(t)  -  V*(j)  +  n~aV(k,  [ns])}  . 

0  £  s  £  I 


However,  since  V & 


Vk  where  Vk  has  continuous  paths. 
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sup  n  “  V(k,  [/w])  =^»  0  in  D [0,  »)  ; 

OSjSI 

i.e.,  the  maximum  jump  functional  is  continuous.  Hence,  by  the  convergence-together  theorem 

(Theorem  4.1  of  Billingsley)  and  induction,  (£>trt . D &)  converges  if 

(/iC^n).  •  •  •  ./*(^«))  converges.  However,  it  is  easy  to  see  (e.g.,  by  Section  6  of  Whin 
(1980)  and  induction)  that  (/i ,  .  .  .  ./*)  :  £>[0.  «>)**  — »  D[0,  »)*  is  continuous  for  each  k. 
Since  we  are  using  the  product  topology,  that  implies  that  /  itself  is  continuous.  Hence,  the 
desired  convergence  holds  by  the  continuous  mapping  theorem  (Theorem  5.1  of 
Billingsley).  ■. 

Remark  (3.1)  By  the  duality  in  Corollaries  2-4,  Theorem  3.1  can  also  be  regarded  as  a  direct 
consequence  of  previous  heavy-traffic  limit  theorems  for  the  sojourn  times  of  the  first  LmJ 
customers  at  the  first  k  queues;  see  Iglehart  and  Whitt  (1970),  Harrison  (1973),  and 
Reiman  (1984).  For  the  sojourn  times,  the  case  we  consider  corresponds  to  having  the  traffic 
intensity  at  queue  i  be  p,  =  1  for  all  i.  As  in  previous  heavy-traffic  limit  theorems,  we  could 
let  the  service-time  distributions  change  in  the  limit.  ■ 

We  can  obtain  a  representation  for  the  limit  process  D  in  Theorem  3.1  paralleling  the 
representation  of  D(k,  n )  as  the  maximal  partial  sum  of  the  service  times  over  all  paths  in 
riot,  n)  in  (2.4).  For  this  purpose  let  Tk(t)  be  the  set  of  nondecreasing  (k  +  l)-tuples 
(r0,  ft .....  tk)  with  t0  =  0  and  r*  =  f.  The  following  is  deduced  from  (3.2)  by  induction 
on  k. 

Corollary.  The  limit  process  D  *  {Dk  :  k  >  1}  h  /(V)  a  [fk(V j, . .  .  yV k)  :  k  2  1}  can 
be  represented  as 

Dk(t)  =  sup(2:  [Vi(ti)  -  V((r,.,)]  :(r0,ti . r*)eTt(r)}  (3.3) 

;-i 


for  all  k  5  1. 
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The  standard  case  has  normalization  exponent  a  =  1/2  in  (3.1)  and  service-time  limit 
process  V  being  Brownian  motion  (BM),  i.e.,  a  vector  of  independent  one-dimensional  BMs. 
The  resulting  limit  process  D  for  the  departure  process  is  then  an  infinite-dimensional  reflected 
Brownian  motion  (RBM)  on  the  infinite-dimensional  orthant.  Such  infinite-dimensional  RBMs 
can  be  constructed  by  extending  corresponding  /(-dimensional  RBMs  on  the  /(-dimensional 
orthant;  see  p.  83  of  Neveu  (1965).  The  /(-dimensional  RBMs  in  turn  coincide  with  those 
considered  by  Harrison  (1978),  Harrison  and  Reiman  (1981a, b),  Reiman  (1984)  and  Harrison 
and  Williams  (1987a,b). 

Let  B  -  be  a  standard  BM  on  D[0,  <»)**,  by  which  we  mean  a  vector  of 

independent  standard  (drift  0,  diffusion  coefficient  1)  BMs.  To  obtain  the  standard  limiting 
case,  we  assume  that  the  service  times  are  i.i.d.  However,  in  order  to  cover  the  case  of  a 
general  external  arrival  process,  we  exclude  finitely  many  queues  in  the  condition. 

Theorem  3.2.  If  there  exists  a  finite  m  such  that  {V(k,  n)  :  k  S  1,  n  £  m}  is  i.i.d.  with 
E  V(l,  m)  -  1  and  Var  V(l,  m)  =  c2  <  <»,  then  the  condition  of  Theorem  3.1  holds  with 
V  =  cB  where  B  is  a  standard  BM.  Then  D  =  af(B)  for  /  in  (3.2).  The  associated 

A  AAA  A 

interdeparture-time  limit  process  A,  defined  by  A*  =  Dk+ j  -  D*.  k  t  1,  and  A0  ®  D\,  can 
be  represented  as 

-  -  -  -  *-I  A 

Ao  =  OB i  ,  Yk  =  o£*+ 1  -  £  A, 

i-0 

A*(0  =  ^*(0  -  inf  y*(j)  ■  y*(r)  +  /*(r)  .  *  ^  1  .  (3.4) 

0 

A  A  A  A 

Then  [(Ai,  .  .  .  ,A*),  (/lt . .  .  ,/*)]  are  the  unique  pair  of  /(-dimensional  processes  so  that 
A,(r)  =  K,(r)  +  /,(r),  A,(r)  ^  0,  /,(r)  is  nondecreasing  with  7,(0)  =  0  and 

J0  =  0 

for  1  Z  i  £  k  and  t  2  0.  Moreover,  for  each  k,  (A\ . A*)  is  a  ^-dimensional  RBM  as  in 
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Harrison  and  Reiman  (1981a, b)  generated  by  a  zero-drift  BM  with  covariance  matrix  I  having 
elements  =  2c2  ,  1  <>  i  <,  k,  1, 1  +  \  =  Ii  +  1  ,•  =  -  o2,  1  <,  i  £  k  -  1,  and  =  0 
otherv  e,  and  reflection  matrix  R  =  /  -  Q,  where  £  1,1  +  1  =  1  for  1  <  i  <  k  -  1  and 
Q,j  =  0  otherwise. 

Proo/.  By  Theorems  3.2,  4.1  and  16.1  of  Billingsley  (1968),  Vn  =>  cB.  By  induction, 
/(ax)  =  af(x )  for/ in  (3.2).  Hence.  D  =  /(aB)  =  a/(B).  The  representation  (3.-*)  is  an 

easy  consequence  of  (3.2).  The  characterization  of  the  pair  [(Alf  .  .  .  ,A*),  (/1 . /*)] 

follows  from  repeated  application  of  the  one-dimensional  characterization  of  the  reflection  map 
on  p.  19  of  Harrison  (1985)  (sometimes  called  Skorohod’s  lemma  (1961)),  and  induction.  The 
characterization  of  (Aj ,  A*)  as  an  RBM  follows  by  the  arguments  of  Harrison  (1978)  and 

Harrison  and  Reiman  (1981a,b)  or  directly  from  those  papers,  after  exploiting  the  duality  in 
Corollaries  2-4  of  Proposition  2.1.  The  RBM  structure  is  easy  to  see  in  this  case  of  an  acyclic 
network  by  writing  (3.4)  in  differential  form.  Then 

dA0  =  dB  j 

dAk  =  dB*+ 1  -  2  dA,  +  dlk  .  (3.5) 

i-0 

By  induction,  (3.5)  can  be  rewritten  as 
dA$  =  dB  | 

dA  j  —  dB  2  -  dB  1  +  dl  \ 

dAk  =  dBk+{  -  dBk-  dik.x  +  <U k  ,  k  >  2  .  (3.6) 

This  is  the  differential  form  for  the  RBM  plus  A0;  i.e.,  from  (3.6)  we  obtain  Z  =  X  +  17?  as 

in  Harrison  and  Reiman  (1981a, b),  where  Z  =  (Aj . A*),  X  is  the  BM  with  components 

X,  =  B(  +  l  -B,  and  K  =  (/, . /*).  ■ 

Remarks  (3.2)  Additional  characterizations  of  the  departure  RBM  such  as  the  generator  and  a 
generalized  Ito’s  formula  follow  from  Harrison  and  Reiman  (1981a, b).  Since  the  BMs  B,  in 
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the  construction  have  zero  drift,  the  departure  RBM  does  not  have  a  proper  stationary 
distribution. 

(3.3)  We  do  not  know  much  about  the  joint  distribution  of  (A i  ( 1 ) . A*(  1 )). 

A  A  A  A  ^  AA  A 

However,  since  At  =  oB 2  -  cB\,  Ai  =  \2  a  |  .  Hence,  A t  ( 1 )  has  a  positive  normal 
distribution  with  £[At(l)]  =  2o/VtT  and  £[At(l)2]  =  2o2.  In  Section  5  we  show  that 
A *(r)  is  stochastically  decreasing  in  k  and  stochastically  increasing  in  t. 

4.  The  Strong  Approximation 

Under  the  assumptions  of  Theorem  3.2,  we  know  that  the  interdeparture  times  of  the  k*' 
customer  from  the  n*  queue  are  asymptotically  of  order  Vn  as  n  -»  »  for  any  k.  We  now 
want  to  say  what  happens  if  the  customer  index  increases  with  n.  For  this  purpose,  we 
establish  a  strong  approximation  result,  drawing  on  Komlds,  Major  and  Tusnddy  (1975,  1976): 
see  p.  107  of  Csorgo'  and  Rdvdsz  (1981).  We  show  that  the  error  in  the  diffusion 
approximation  is  0(n^a  ~  log  n)  when  the  largest  customer  index  k  is  na.  We  state  the 
result  below  in  an  equivalent  unnormalized  form;  to  obtain  the  stated  bound,  divide  through  by 

V^. 

Theorem  4.1.  If,  in  addition  to  the  assumption  of  Theorem  3.2,  all  service  times  are 
independent  and  there  exist  positive  constants  K  and  X  such  that  P(V(k,  j)  >  x)  <.  Ke'**  for 
all  k,  j  and  x,  then  there  exists  a  probability  space  supporting  the  departure  times  D(k,  j )  and 

A  A 

the  limit  process  D  =  o/(£)  such  that,  for  any  a  >  0, 

max  {\D(k,  j)  -  j  -'Tii  Dk(j/n)\ }  =  0(n°\ogn)  a.s. 
l  s  *  s  i»*j 

1  S  j  S  a 

Remarks.  (4.1)  Theorem  4.1  establishes  part  of  the  second  case  of  Theorem  1.1  with 
0  <  a  <  1.  To  determine  the  order  of  magnitude  of  D(kn,n)  for  k„  =  LxnaJ  for 
0  <  a  <  1,  we  have  thus  reduced  the  problem  to  determining  how  Dk(  1)  behaves  as  k  -*  <», 
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which  we  discuss  in  Section  7. 

(4.2)  In  Theorem  4. 1  we  focus  on  the  departure  times,  but  a  corresponding  result  holds  for 
the  interdeparture  times  A(k,  n)  in  (2.5)  by  applying  the  triangle  inequality.  In  particular,  as 
an  immediate  consequence  of  Theorem  4.1, 

max  {|A(*,  ;')  -  'Tn  [D k  +  i(jl n)  -  D*(;7n)]|}  =  0(nalogn)  a.s.  (4.1) 
l  s  *  s  L»*J 

1  £  j  S  n 

Theorem  4.1  is  proved  by  combining  Lemmas  4.4  and  4.5  below.  Lemmas  4. 1-4.3  below 
are  used  to  prove  Lemma  4.4. 

Lemma  4.1.  If  {U k  :  k  >  1}  is  a  sequence  of  independent  random  variables  and  there  exist 
positive  constants  K  and  X  such  that  P(Uk  >  x)  £  Ke~Xx  for  all  x  >  0,  then  for  any  a  >  0 

max,  {£/*}  =  0(log  n)  a.s. 

ISiS  U*J 

Proof.  For  any  xn, 

P  max  {Uk}  >  x J  $  1  -  (1  -  Ke~U'y‘  . 

U  S  *  S  Ln‘J 

Hence,  for**  =  (a  +  2) log  n/X, 

P(A„)  rn  />(  max  {Uk}  >  log  n)  Z  1  -  (1  -  tfn-(fl+2>)»* 
l  s  *  s;  L»*J  A. 

5  1  -  exp(log[(l  -  ATn"(a+2))"‘]) 

S  1  -  exp(na  log  [1  -  AT/T(a+2)]) 

£  -  na  log  (1  -  Avj'(a+2)) 

£  2Kn~2  for  n  sufficiently  large 

2  3 

X  X 

using  e'x  >  1  -  x  in  the  second  to  last  step  and  log(l  -  x)  =  -  x  — - - - —  ...  for 

•• 

0  <  x  <  1  in  the  last  step.  Since  £  P(A„)  <  <»,  P(An  infinitely  often)  =  0  by  the 

n  m  1 
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Borel-Cantelli  lemma.  Hence,  there  are  positive  random  variables  X\  and  X2  such  that 

max  {[/*}  <  Xi  +  X2  log  n  for  all  n  >  1  a.s.  ■ 

1  S  Jk  S  Ln'J 

We  now  extend  a  strong  approximation  result  of  Komlds,  Major  and  Tusnddy  (1975,  1976), 
p.  107  of  Csorgo'  and  Rdvdsz  (1981). 

Lemma  4.2.  Under  the  assumptions  of  Theorem  4.1,  there  is  a  probability  space  supporting 
independent  standard  BMs  B  k  and  the  service  times  so  that 

£  V(k.  j)  -l- 
)•  i 

Proof.  The  service  times  of  all  customers  at  all  queues  after  the  first  m  are  i.i.d.,  but  we  do  not 
have  identical  distributions  at  earlier  queues.  However,  by  Lemma  4.1  and  the  assumption  of 
Theorem  4.1,  without  loss  of  generality  it  suffices  to  assume  that  all  the  service  times  are  i.i.d. 
To  support  half  this  claim,  note  that  o B*(0  is  normally  distributed  with  mean  0  and  variance 
la2,  so  that  these  variables  satisfy  the  same  tail  condition  imposed  on  the  service  times  for 
1  £  /  £  m  (possibly  with  different  constants  K  and  X).  Hence,  it  suffices  to  assume  that 
{^(*.7)}  is  i.i.d.,  with  the  distribution  of  V(l,m),  and  we  do.  By  Komlds,  Major  and 
Tusnddy  (1975,  1976),  for  each  k  there  is  a  probability  space  containing  a  BM  Bk  such  that 

P{  max  |  V  V(k,  j)  -  l-  oBk(l)\  >  Clog  n  +  x}  <  Ke~^ 

1  7-1 

for  positive  constants  C,  K  and  \  depending  on  the  distribution  of  V(l,  m).  Hence,  us«.  3  a 
product  space,  we  can  achieve 


max 

1  £  *  <  Ln'J 

1  S  /  £  « 
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As  in  Lemma  4.1,  choose  xn  =  (a  +  2)log  n/\  to  obtain  P(An)  £  2 Kn~2  for  n  sufficiently 
large.  By  Borel-Cantelli,  P(An  infinitely  often)  =  0.  Hence,  there  exist  random  variables 
X  j  and  X2  such  that 

i 

max  V  V(k,  j)  -  l  -  oBk(l)  <,  Xx  +  X2  log  n  a.s.  ■ 

IvJ  IZ i 

IS  /  S  »  1 

»  J 

For  the  next  lemma,  we  specify  some  quantities  associated  with  a  real-valued  function 
defined  on  the  positive  integers,  say  y.  Let 

yT(n)  =  max  y(k)  and  ||y||„  =  |y|T(n)  ,  n  >  1  .  (4.2) 

1  S  *  S  n 

The  following  elementary  lemma  can  be  viewed  as  a  special  case  of  Theorem  6.1  of 
Whin  (1980). 

Lemma  43.  For  all  n  £  1,  ||yj  —  yl  IU  *  ll^i  ~  yi  IU- 

Let  £>’(*,  n)  be  the  following  function  of  the  limiting  BM  B, 

D*(l,n)  =  ofl,(n) 

D*(k,  n)  -  oBk(n)  -  min  [cBk(j)  -  D\k  -  1,  ;)}  (4.3) 

1  S  j  S  n 

=  max  [D*(k  -  1,  ;)  +  oBk(n)  -  oBk(j)} 

1  S  >  S  n 

for  n  2  1  and  k  £  2.  Let  e  denote  the  identity  function,  i.e.,  e(t)  =  t,  t  2  0. 

Lemma  4.4.  Under  the  assumptions  of  Theorem  4.1,  for  any  a  >  0  there  exists  a  probability 
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space  supporting  the  departure  times  D(k,  j )  and  the  process  Dm  in  (4.3)  such  that 

max  {\D(k,  j)  -  j  -  D\k,  j)  | }  =  0(nalog  n)  a.s. 
l  s  *  s  L»*J 
1  S  ;  S  n 

Proof.  Note  that  (4.3)  is  not  quite  the  same  function  of  o B k(n)  as  D(k ,  n )  is  of 

n 

]T  [VT&,  j)  -  j]  in  (2.2).  The  exactly  corresponding  function  is 

;  =  i 

D'(l.n)  =  aB{(n) 

D'(k,n)  =  max  {D(k  -  1,  j)  +  aBk(n)  -  oBk(j  -  1) }  .  (4.4) 

l  s  j  s  n 

However,  by  (2.2),  (4.1),  (4.2),  (4.4)  and  Lemmas  4.1  and  4.3,  there  are  random  variables  Xi 
and  X2  such  that 

II D\k,  •)  -  D*(*.  -)IL  *  ||Z>'(*  -  1.-)  -  D\k  -  l.-)IL 

+  max  (|oB*(;)  -  oBk(j  -  1)|} 
l  s  j  s  » 

<  ||D'(*  -  1,0  -  D*(k  -  1,  )|L  +  X,  +  X2  log n  (4.5) 
5  k(Xx  +  X2l0gn)  for  k  £  lna\  , 

where  we  have  used  the  fact  that  oBk(j)  -  cBk(j  -  1)  are  i.i.d.  normal  random  variables  in 
the  second  to  last  step  and  induction  in  the  last  step.  In  particular,  by  Lemma  4.1, 

max  {|o£*0)  -  oBk(j  -  1)|}  =  O(logn)  a.s. 
i  s  *  s  jvj 

1  S  j  £  n 

Hence, 

max  A\D\k,j)  -  D*(k,  j)\]  <;  n\Xx  +  *2  log  n) 

I  i  *  s  l**J 
1  S  )  S  A 


and  it  suffices  to  do  the  proof  with  D'  in  (4.4)  instead  of  D*  in  (4.3).  By  an  argument  just 
like  (4.5),  using  Lemma  4.2  now,  there  exist  a  probability  space  supporting  the  processes  D 
and  D’  and  finite  random  variables  X i  and  X2  such  that 
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||D(1,  )  -  «(■)  -  0'(1.)II,  <  Xx  +  X2  log n  a.s. 
and 

II D(k.  )  -  e(  )  -  D'(k,  Oil,  £  +X2  log n  +  ||0(*  -  1,0  -  e(  )  -  D'(k  -  l.Oll,.  a.s. 

for  1  <  k  <  UaJ.  Hence, 

||£>(*,  0  -  e(  )  -  £>'(*,  Oil,  £  +  X2  logn)  =  0(nalogn)  a.s. 

for  all  £  <  LnaJ.  ■ 

To  prove  our  next  lemma  we  want  a  continuous  analog  of  (4.2).  For  a  real-valued  function 
of  a  real-variable,  say  y,  let 

yT(r)  =  sup  y(s)  and  ||y||,  =  |y|T(t),r>0.  (4.6) 

0  5  s  £  / 

Paralleling  Lemma  4.3, 

llyl  -ylll/  ^  ||y i  -y2ll/  •  (4.7) 

Lemma  45.  For  any  a  >  0 

max  {|D*(fc,  j)  -  'fnDk(j/n)\}  =  0(nalogn)  a.s. 
l  s  *  s  l«*J 
1S;S» 

Proof.  Note  that 

(VnO(r/n)  :  t  £  0}  =  {D(t)  :  t  £  0} 
and 

d 

{D*(k,  [t])  02  1.  t  2  0}  =  {£>*([(])  021,(20}. 

Hence,  what  we  want  to  show  is 

sup  {\£>k(t)  -  Dk{[t])\)  =  0{na\ogn)  a.s.  (4.8) 

1  S  *  S  la*J 
0  S  f  S  , 


By  (4.7), 
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II D*(  )  -  D*([-])ll.  *  l|D*_,(  )  -  £*_,([  ]) ||„  +  ||oBt(  )  -  oB*(N)ll„  .  (4.9) 

However, 

max  ||aS*(  )  -  oS*([-])|U  <  o  max  {  sup  {  |St(s)  -  Bk(j)\ }}  (4.10) 
ISiS  L»*J  ISiS  l"‘J  J  <  s  <  j  *  1 

1  S  1  S  n 

<  Xi  +  X2  logn  a. s. 

for  finite  random  variables  X}  and  X2,  by  Lemma  4.1.  Combining  (4.9)  and  (4.10)  gives 
(4.8).  ■ 

5.  Stochastic  Order  for  the  Interdeparture  Times 

In  this  section  we  establish  stochastic  comparisons  for  the  interdeparture  times  A(k,  n)  in 
(2.5).  We  say  that  a  random  element  X  t  is  stochastically  less  than  or  equal  to  another  random 
element  X2,  and  write  Xt  <ls,  X2,  if  Eh(X\)  £  Eh{X2)  for  all  nondecreasing  bounded 
measurable  real-valued  functions  h ;  see  Kamae,  Krengel  and  O’Brien  (1977).  We  are 

d 

interested  in  the  case  X,  is  an  array  of  real-valued  random  variables.  As  before,  let  =  denote 
equality  in  distribution. 

Theorem  5.1 .  Suppose  that  the  service  times  V(k,  n)  are  all  mutually  independent. 

d 

(a)  If  V(k,  n)  =  V(  1 .  n)  for  all  k  £  1  and  n  £  1,  then 

(A (k  +  i ,  n)  :  k  >  1 ,  n  £  1 }  (A (k,  n)  :  k  t  1 ,  n  £  1 }  , 

so  that 

V(l,  n )  A (k  +  1,  n)  Sjr  A (k,  n)  for  k  £  1  and  n  t  1  . 

d 

(b)  If  V(k,  n)  =  V(k.  1)  for  all  k  5  1  and  a  2  1,  then 

(A  (k,  n )  :  k>  1.  n't  1}  S„{A(*.  n+l):*Sl,n*l}, 


so  that 
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V(k  +  1.  1)  <>„  A (k,  n)  <sl  A(k,  n  +  1)  for  k  >  1  and  n  >  1  . 

Proof.  We  do  only  pan  (a)  because  the  proof  of  (b)  is  similar.  We  construct  a  process 
{AU  +  l,n):k>l,n>l}  with  the  same  finite-dimensional  distributions  as 
{A (k  +  1,  n)  :  k  >  1,  n  >  1}  such  that 

A(k  +  1 ,  n)  <  A(k,  n)  a.s.  for  ail  k  >  1  and  n  k  1  .  (5.1) 

For  this  purpose,  we  use  service  times  V(k,  n)  defined  by  V(k  +  1 ,  n)  -  V(k,  n)  for  all  k  and 
n.  By  our  assumptions,  {V(k,  n)  :  k  >  \ ,  n  >  \  }  is  distributed  the  same  as 
{ V(k,  n)  :  k  £  1 ,  n  >  1 }.  We  define  A (k,  n)  and  D(k,  n )  just  like  A(k,  n)  and  D(k,  n)  but 
using  the  service  times  V(k,  n)  instead  of  V(k,  n). 

By  (2.1), 

A (k,  n)  =  max{D(l:,  n) ,  D(k  +  1 ,  n  -  1)  }  +  V(k  +  1 ,  n)  -  D(k,  n) 

=  [D(k  +  1,  n  -  1)  -  D(k,  n)]*  +  V(k  +  1.  n)  .  (5.2) 

Hence, 

A(*  +  1,  n)  =  [D(k  +  2,  n  -  1)  -  D(k  +  1,  n)]+  +  V(k,  n )  .  (5.3) 

From  (5.2)  and  (5.3),  we  see  that  (5.1)  holds  if 

D(t  +  2,/i-l)-D(t+l,n)SD(i+l,/i-l)  -  D(k,  n)  (5.4) 

for  all  k  >  1  and  nil.  We  establish  (5.4)  by  induction  on  the  sum  of  the  indices  (m  =  k  +  n 


in  D(k,  n)).  Note  that 
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D(k  +  2.  n  -  1)  -  D(k  +  1.  n)  = 

ma x{D(k  +  1 .  n  -  1).  D(k  +  2,  n  -  2) }  +  V(k  +  2.  n  -  1) 

-  max  {£>(£,  n),  D(k  +  1 ,  n  -  1)}  +  V(k  +  1 ,  n) 

=  [D(*  +  2,  n  -  2)  -  D(k  +  1,  n  -  1)]+  +  V(*  +  2,  n  -  1) 

-  [D(k,  n )  -  D(k+  \.n-  1)]+  +  V(ik  +  1,  n) 

=  [D(*  +  2.  n  -  2)  -  D(k  +  1,  n  -  1)]+  +  V(*  +  1.  n  -  1) 

+  [D(i  +  1,  n  -  1)  -  D(k,  «)]“  -  V(k,  n) 

<  [D(k  +  1.  n  -  2)  -  D(*.  n  -  1)]+  +  V(k  +  1,  n  -  1) 

+  [D(/t.  n  -  1)  -  D(k  -  1.  n)]~  -  V(k,  n)  *  Z 

by  the  induction  hypothesis,  where 

Z  =  max{D(/fc  +  1,  n  -  2),  D(k,  n  -  1)}  -  D(k ,  n  -  1)  +  V(k  +  1,  n  -  1) 

-  max{£>(*-l,  n) ,  D(k,  n  -  1)}  +  D(k,  n  -  1)  -  V(k,  n) 

=  D(k  +  l,  n  -  1)  -  D(k,  n)  . 

To  start  the  induction,  note  that,  for  n  =  1  and  any  k, 

D(k  +  2,n  -  1)  -  D(k  +  1.  n)  =  -  D(k  +  1,  1) 

=  -  (V(l,  1)  +•••+  V(k  +  1,  1))  =  -  V(l.  1)  -  [V(l,  1)  +•••+  V(k,  1)] 

iS  -  D(k,  1)  =  D(k  +  1, 0)  -  D(k,  1)  . 

Hence,  (5.4)  is  established  and  the  proof  is  complete.  ■ 

Corollary  I.  Under  the  conditions  of  Theorem  5.1(a),  for  each  n  2:  1  there  exists  a  proper 
stochastic  process  {A (k,  n)  :  k  Z  1 }  with  A(ik,  n)  V(l,  n)  such  that 

{A(t  +  j,  n)  :  k  'Z  1 }  =>  (A {k,  n)  :  k  2  1 }  in  R”  as  j  —*  <*>  . 

We  can  apply  Theorem  5.1  to  obtain  a  stochastic  comparison  for  the  limit  process  in 
Theorem  3.1.  We  actually  focus  on  the  associated  interdeparture-time  limit  process 
A*(f)  =  Dk  +  i(t)  -  Dk(t). 

Corollary  2.  Suppose  that  the  service  times  V(k,  n)  are  all  independent  and  the  FCLT 
V„  =>  V  holds  as  required  for  Theorem  3.1. 
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d 

(a)  If  V(k,  n )  =  V(l,  n)  for  all  k  >  1  and  n  >  1,  then 

{A*+1(0  :k>  1,  r  >0}:S„  (A*(r)  :  *  £  l,r>0} 

for  all  k  >  1. 

d 

(b)  If  V(k,  n )  =  V(k,  1)  for  all  k  >  1  and  n  >  1,  then 

{A*(0  :  k>  1, ;  >  0}  Zst{Ak(t  +  u)  :  1.  r  >  0} 

for  all  u  >  0, 

Proof.  Use  the  fact  that  stochastic  order  is  preserved  under  weak  convergence.  ■ 

6.  The  Hydrodynamic  Limit:  The  Case  k„  =  0(n) 

In  this  section  we  describe  the  behavior  of  D(k„ ,  n )  (and,  equivalently,  D(n,  kn ))  when  kH 
is  of  order  n.  We  first  apply  the  hydrodynamic  limit  of  Rost  (1981)  as  discussed  in 
Section  4.2  of  Srinivasan  (1989)  to  treat  the  special  case  of  exponential  service  times. 

Theorem  6.1.  If  all  the  service  times  are  i.i.d.  with  an  exponential  distribution  having  mean  1, 
then 

lim  n-1D(bcnJ,  n)  =  (1  +  V7)2  a.s.  for  any  x  >  0  . 

n  — 

Proof.  By  Section  4.2  of  Srinivasan  (1989),  the  average  queue  length  among  the  first  Led 
queues  at  time  t  is  asymptotically  a.s.  (2  -  Vx)/V 7  as  t  ->  «.  Hence,  for  x  >  1,  the 
average  queue  length  among  the  first  n  and  \jc2n]  queues  at  time  ix2nj  are  asymptotically  a.s. 
(2  -  x-1)/x-1  =  2x  -  1  and  1,  respectively,  as  n  ->  «.  Hence  asymptotically  a.s.  there  are 
x2 n  +  o(n)  customers  in  queues  2  through  x2 n  and  (2x  -  l)n  +  o(n)  customers  in  queues  2 
through  n.  Hence,  asymptotically  a.s.  (x2  -  2x  +  l)n  +  o(n)  customers  have  departed  from 
queue  n,  and  the  departure  time  for  customer  ( x 2  -  2x  +  l)n  from  queue  n  is  x2n  +  o(n). 
Now  do  a  change  of  variables,  replacing  (x  -  1  )2  by  x. 
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d 

To  treat  x  <  1,  note  that  n-1  D(Lt2nJ,  n )  =  n_1  D(n,  Lc2nJ).  Let  rt'  =  x2  n.  Then 
n_1  D(n,  bc2nJ)  =  (x2/n)D(  Ln/jc2_! ,  n)  +  o(  1).  From  the  previous  argument, 

2 

(x2/n)D(  L/i/jc2J  .  n)  -*  x2  —  +  1  =  (x  +  l)2  a.s.  as  n  — ►  «  . 

* 

L  - 

For  x  =  1.  consider  the  average  queue  lengths  among  the  first  n  and  4n  queues,  and  reason 
similarly.  ■ 

We  now  establish  the  existence  of  a  limit  for  a  general  service-time  distribution  having  an 
exponential  tail.  First,  recall  that  under  the  conditions  of  Theorem  4.1, 

i  {  V(i,  ;)}  =  0(log  n)  a.s. 

\ijin 

by  Lemma  4.1,  so  that 

D([jcn],n)  £  0(n  log  n)  a.s. 

However,  we  will  show  that  £>(  LcnJ ,  n)  is  actually  O(n). 

For  this  purpose,  we  exploit  a  stochastic  comparison  involving  associated  random  variables; 
see  p.  29  of  Barlow  and  Proschan  (1975).  Recall  that  a  family  of  random  variables  are 
associated  if  all  pairs  of  nondecreasing  bounded  real-valued  functions  of  the  random  variables 
have  nonnegative  correlation. 

Lemma  6.1.  If  the  service  times  {V(i,  j)  :  1  £  i  S  k,  1  £  ;  £  n}  are  independent  or  just 
associated,  then  the  partial  sums  £  V(i,  j)  for  the  *  t  n  “  2  paths  *  in  n(jfc,  n)  are 

associated  random  variables. 

Proof.  The  partial  sums  are  all  nondecreasing  functions  of  the  kn  service  times.  ■ 

Theorem  6.2.  If  the  service  times  V(i,  j )  are  all  independent,  then 
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D(k,  n)  <sl  max{SR  :  rt  €  n(&,  n) } 
where  Sn,  it  e  Yl(k,  n),  are  mutually  independent  with 

=  S  V(i,  j) 

(*.»  e  « 

for  each  path  rc. 

Proof.  Apply  Theorem  3.2,  p.  33  of  Barlow  and  Proschan  (1975).  ■ 

We  now  use  this  stochastic  bound  to  develop  a  bound  and  heuristic  estimate  for 

lim  n~l  D(\jcn,  nj)  for  a  general  service-time  distribution.  We  call  this  the  path- 

n  — ►  oo 

independence  bound.  We  also  use  this  bound  to  show  that  the  limit  exists. 

Theorem  6.3.  If  all  the  service  times  are  i.i.d.  with  EV(  1,  1)  =  1  and  there  exist  positive 

constants  K  and  X  such  that  P(V(l,  1)  >  x)  £  Ke~Xx  for  all  x  >  0,  then  there  exists  a 

deterministic  strictly  increasing  concave  function  y(x)  with  y(x)  £  1,  y{x  +  y)  -  y(x)  >  y 
and  Y(x)  =  xy(x~ 1 )  for  all  x,  y  >  0  such  that 

lim  n-1D(UxJ,n)  =  y(x)  a.s.  (6.1) 

n  — ♦  •• 

and 

lim  £|n_lD(LnxJ,  n)  -  Y(x)|  =0  (6.2) 

for  all  x  >  0.  Moreover, 

' 

1  +  xE(max{V(l,  2),  V(2,  1)})  S  1  +x.  0  <  x  £  1 
y(x)  S  (6.3) 

x  +  £(max{V(l,  2),  V(2,  1)})M+x,1Sx, 

. 

and 


y(x)  z  (1  +  0(1  +*) . 


(6.4) 
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where 

a *  *  a*(x)  =  inf{a  >  0  :  (1  +  x)h(a)  >  (1  +  x)  log  (1  +  x)  -  x  log  x}  (6.5) 
and 

h(a)  =  sup  {0a  -  log  Ee*[V(Um)  “  11  }  .  (6.6) 

8 

Proof.  We  first  establish  the  upper  bound  in  (6.4).  Using  Stirling’s  formula,  p.  52  of 
Feller  (1968),  we  see  that  the  number  of  paths  in  n(  Lt/rJ,  n)  is  $(x,  n)  =  +  0("),  where 

V(x)  =  ( 1  +  x)  log  ( 1  +  x)  -  x  log  x  . 

Let  rtn  be  a  path  in  II ( LxnJ,  n)  and  let  SKn  be  the  partial  sum  of  all  service  times  on  path  it*. 
By  the  Cramdr  (1938)-Chemoff  (1952)  theorem, 

P(SKm  >  (1  +  a)(l  +  x)n)  =  e-0  ♦*)*«•)  +  •(■) 

where  h  is  defined  in  (6.6).  Using  the  path-independence  bound  established  in  Theorem  6.2, 
we  have 

P(D(  Lc/rJ ,  n)  >  (1  +  a)(l  +  x)n)  £  1  -  (1  -  *-■«  +*>*(«>+•(«>)♦(*.<•>  .  (6.7) 

The  critical  case  a  =  a*(x)  given  by  (6.5).  If  h(a)  >  h(a'),  then  the  probability  in  (7.7) 
converges  to  0,  whereas  if  h(a)  <  h(a*),  then  the  probability  converges  to  1.  In  particular, 
for  any  a  >  a*. 

2  /’(OdwrJ,  n)  >  (1  +  o)(l  +  x)n)  <  oo  , 

*■1 

so  that  we  can  apply  Borel-Cantelli  to  deduce  that 

lim  n_lD(b:4j,  n)  £  (1  +  a)(l  +  x)  a.s. 


Hence,  we  have  the  claimed  upper  bound  in  (6.4). 
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Now  we  apply  the  subadditive  ergodic  theorem  on  p.  277  of  Liggett  (1985)  to  establish  the 
existence  of  the  limit.  We  first  consider  the  limit  of  n~l  D(kn,  In)  for  k  and  /  integer.  We  let 
*o.o  =  0. 


-X0,n  =  D{kn.  In)  -  V(l,  1) 


and  -Xmn  be  -X0,„-m  applied  to  the  shifted  service  times  V'(i,j)  =  V(i  +  km,  j  +  lm)\ 
e.g.,  for  k  =  l  =  1.  Xn.Un  =  0  and  -Xn.2.„  =  V(n,  n)  +  max{V(n-l,  n),  V(n,  n-1)}. 
With  this  definition,  X  is  subadditive,  i.e.,  Xo,n  ^  Xo,m  +  Xm<n  for  0  £  m  £  n.  Moreover,  X 
satisfies  the  other  conditions  of  the  subadditive  ergodic  theorem;  in  particular, 
{X(„_  i )k,nt '■  n  £  1}  is  a  stationary  process  for  each  k, 

d 

•'  k  2  0}  =  {2fm+|  m+*+1  :  k  2  0}  for  each  m,  and  E(X oi )  <  «.  Hence, 
n~l  D(kn,  In)  has  a  deterministic  limit  Ti(Jk,  /)  in  the  sense  of  (6.1)  and  (6.2)  for  all  integers  k 
and  /.  When  n  is  a  multiple  of  /, 


1  _ 

r  ■> 

kn 

1  *  r. 

f  ' 

,  n  ,n 

—  D 

— ,  n 

-  —  —  D 

k—,  — 

n 

l 

k  j 

l  n 

l  l 

< 

yt|(*,  0  as  n 


a.s. 


More  generally. 


D 


y  /Ln//J./Ln//J 


£  D(Un//J,  n)  £  D 


y /(U//J  +  1),  /([«//]  +  1) 


where 


,-i 


y  lint l],  lint  1} 


In/ 1 j 


T^TTJ 


D(*Ln/fJ)  ,/L«//J) 


y  11(*.  0 


and 
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n"1  D  +  1),/(L«//J  +  1)  =  *  1  [n//j  7  J  D(k(lnll]  +  1),/(L«//J  +  1)) 

-*  y  ri(^,  /)  as  n  -»  oo  a.s. 

Hence,  (6.1)  holds  for  all  positive  rational  x.  A  similar  argument  applies  to  (6.2). 

To  treat  irrational  x,  we  apply  Theorem  5.1a  to  deduce  that  y(x  +  y)  -  y(x)  is  decreasing 
in  x  through  rational  x  for  each  rational  y.  Hence,  y  is  nondecreasing  and  concave  restricted  to 
the  rationals.  Since  y  is  nondecreasing  overall,  y  is  nondecreasing  and  concave,  and  thus 
continuous,  overall.  Hence,  the  limits  (6.1)  and  (6.2)  extend  to  irrational  x.  (Note  that 

n~l D(lnx],  n)  is  sandwiched  between  corresponding  averages  for  rationals  that  converge. 

This  implies  the  existence  of  convergent  subsequences  as  n  -»  <».  The  continuity  of  y  on  the 
rationals  then  implies  that  all  limits  of  convergent  subsequences  converge  to  a  common  limit, 
implying  convergence  for  the  full  sequence.) 

To  see  that  y(x  +  y)  -  y(x)  2  y,  so  that  y  is  strictly  increasing,  use  the  fact  that 

i  i  ii  ‘  “  U*  +  y)«J 

£>(L(x  +  y)nj,  n)  >  D(LxnJ,  n)  +  £  V(i,  n)  . 

i  ■  LdiJ  +  1 

By  considering  only  paths  through  (2 k,  2k)  for  all  k,  1  £  k  £  min {xrt,  n },  we  easily 

obtain  the  lower  bound  in  (6.3).  To  see  that  y(x)  £  1  for  all  x  >  0,  note  that,  for  all  x, 

d 

D(  ben],  n )  >  D(l,  n )  for  all  n  sufficiently  large.  Since  D(k,  n)  =  D(n,  k)  for  all  n  and  k, 
we  see  that 

y(x)  =  lim  n~lD(lxn],  n)  =  lim  ^xn^.  .  1  ,  D(Lx/d.  UaJ/x) 
n  n  ben] 

=  lim  t“~t  D(LxnJ/x,  LxnJ)  =  xy(x"x)  .  m 
n  ~  n  bxn] 

To  illustrate  the  path-independence  bound,  in  (6.4)-(6.6)  suppose  that  the  service  times 
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have  an  exponential  distribution  as  in  Theorem  6.1.  Then 

£gfl[V(i,  i)  -  il  =(i-0)-1e-9  and  h(a)  =  a  -  log(l  +  a)  .  (6.8) 

From  (6.5)  and  (6.8),  we  obtain  a’  by  solving 

(1  +  x)[a  -  log(l  +  a)3  =  (1  +  x)  log  (1  +  x)  -  x  log  x  , 
which  for  the  case  x  -  1  is 

a'  -  log(l  +  a')  =  log  2  , 

yielding  a*  =  1.68  and  lim  n_1  D(n,  n)  £  5.36.  From  Theorem  6.1  we  see  that  this  is 

rt— *<» 

indeed  an  upper  bound,  which  seems  to  be  not  a  terrible  approximation.  Evidently,  there  is 
enough  dependence  among  the  paths  to  reduce  this  estimate  by  a  factor  of  0.746. 

Example  6.1.  It  is  possible  that  the  infimum  in  (6.5)  is  not  attained  as  an  equality.  For 
example,  suppose  that  V(i,  j)  is  Bernoulli,  assuming  the  values  0  and  2  each  with  probability 
1/2.  Then  h(a )  =  [(1  +  a)  log  (1  +  a)  +  (1  -  a)  log  (1  -  a)]/2,  0  £  a<  1,  and 
/i(a)  =  oo  for  a  2  I.  For  x  =  1,  lim  A(a)  =  log  2,  so  that  a"  (1 )  =  1,  which  yields 

a  1  - 

Yd)  *  4. 

7,  More  Properties  of  the  Departure  RBM 

We  established  the  strong  approximation  in  Section  4  in  order  to  deduce  more  about  the 
departure  times  of  customer  kn  from  queue  n  when  kH  — ♦  <»  as  n  — >  ».  We  now  establish  a 
limit  for  the  way  the  departure  RBM  components  D*(l)  grow  as  k  -»  «>  that  enables  us  to 
conclude  that  the  average  of  the  first  LxnaJ  interdeparture  times  from  queue  n  after  the  first 
departure  is  of  order  «(1  ~a)n  for  any  x  >  0  and  any  a  satisfying  0  <  a  <  1.  The  limit  is 
obtained  by  applying  the  subadditive  ergodic  theorem  once  more. 

Theorem  7.1.  Let  D  =  f(B).  Then  there  exists  a  deterministic  nondecreasing  concave 
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function  y(x)  such  that 

lim  /T1  =  y(x)  a.s. 


(7.1) 


so  that 

n_v4  ^U«J(1)  =>  YU)  as  n  ->  *  (7.2) 

for  each*  >  0. 

Proo/.  As  in  the  proof  of  Theorem  6.3,  we  apply  the  subadditive  ergodic  theorem  on  p.  277  of 
Liggett  (1985).  We  first  establish  the  limit  for  n~lDj„(lcn)  for  j  and  k  integer.  We  let 
-X0n  =  Djn(n)  and  -Xmn  be  -X0,_m  applied  to  the  shifted  process 

B'i(t)  =  Bi+km(t  +  Im)  -  Bi+imilm).  With  this  definition,  X  is  subadditive,  i.e., 

X0n  S  X0m  +  Xm  H  for  0  <,  m  <,  n,  and  X  satisfies  the  other  conditions  of  the  subadditive 
ergodic  theorem,  except  possibly  for  the  bound.  To  establish  the  bound,  we  consider  a  related 
discrete  problem.  We  consider  the  kn  x  In  integer  lattice.  We  associate  with  the  point  (i.j)  in 
this  lattice  the  random  variable 


W(i,j)  =  sun  |B,(r)  -fl.O  -  1)|  . 
j-\si<j 


It  is  easy  to  see  that 


Djtikn)  £  sup  {  £  W.j)}  +  W(jnjtn)  . 

K  €  THjhM)  {iJ)  €  R 


(7.3) 


(7.4) 


For  each  path  n,  the  random  variables  W(i,  j )  for  (t,  j)  e  n  are  i.i.d.  Moreover,  for  different 
paths,  the  partial  sums  are  associated.  Hence,  we  have  a  path-independence  bound  for  the  right 
side  rf  (7.4)  paralleling  Theorem  6.2.  Using  the  known  tail  behavior  of  W(i,  j )  in  (7.3),  we 
have  the  required  bound  for  the  subadditive  ergodic  theorem.  Hence,  n  (kn)  converges 
a  s  to  a  proper  limit  as  n  -*  oo.  As  in  the  proof  of  Theorem  6.3,  we  use  this  result  to  deduce 
that  (7.1)  holds  for  each  rational  x.  We  then  apply  Corollary  2  to  Theorem  5  to  deduce  that 
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Y(x  +  y)  -  y(x)  is  decreasing  in  x  through  rational  x  for  each  rational  y.  Hence  y  is 
nondecreasing  and  concave  restricted  to  the  rationals.  Since  y  is  nondecreasing  overall,  y  is 
nondecreasing  and  concave  overall.  Hence,  (7.1)  extends  to  irrational  x.  Since 

n~'A  D  LxnJ(l)  =  n-1D[i„j(n)  for  all  n,  we  obtain  (7.2)  directly  from  (7.1).  ■ 

We  now  apply  Theorem  7. 1  to  obtain  a  limit  for  the  average  of  the  first  LnaJ  departure 
times  for  0  <  a  <  1.  The  following  shows  that  this  average  is  asymptotically  of  order 

„(  \-a)/2 

Theorem  7.2.  Under  the  assumptions  of  Theorem  4.1, 

D(\jcna  J,  n)  -  D(l.;t)  ... 

n(l+a)/2 


for  y(x)  in  Theorem  7.1  and  0  <  a  <  1. 
Proof.  Note  that 


£>(LxrtaJ,  n)  -  P(l,  n) 

„(l+o)/2 


(D 

„(l  +  a)/2 


D(LcnaJ,  n)  -  n  -  V/T^Lu,. j(1) 

D(l,  n)  -  n 

„(l+«)/2  J 

„(l+a)/2 

-  - 

(7.5) 


By  (7.2)  in  Theorem  7.1,  the  first  term  on  the  right  in  (7.5)  converges  in  probability  to  y(x). 
By  Theorem  4.1,  the  second  term  on  the  right  converges  in  probability  to  0.  By  (1.1),  the  third 
term  on  the  right  converges  to  0.  ■ 


8.  Concluding  Remarks 

There  are  several  stones  left  unturned.  First,  it  would  be  nice  to  identify  the  hydrodynamic 
limit  y(x)  in  (6.1)  for  non-exponential  service-time  distributions.  It  would  be  nice  to  determine 
how  this  limit  depends  on  the  service-time  distribution.  We  have  established  that  there  is  an 
invariance  principle  for  a  <  1.  We  conjecture  that  the  limit  when  a  =  1  depends  on  the 
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service-time  distribution  beyond  its  first  two  moments.  It  would  also  be  nice  to  establish  a 
refined  distributional  limit,  i.e.,  a  weak  convergence  limit  for  n“a(D(LxnJ.  n)  -  y(x)n)  as 
n  — »  oo. 

Second,  it  would  be  nice  to  know  more  about  the  departure  RBM  f(B )  (Section  3).  In 
Remark  3.3  we  noted  that  Aj  =  -  D\  is  a  reflecting  BM,  so  that  £[Aj(l)]  =  2 o/VrT. 

Moreover,  by  Theorem  5.2,  At(l)  is  stochastically  decreasing  as  k  increases.  However,  it 
would  be  nice  to  know  the  joint  distribution,  or  at  least  the  means,  of  (Aj  (1) , .  . .  ,  A*(  1 )). 
Moreover,  it  would  be  nice  to  know  the  hydrodynamic  limit  y{x)  for  the  Departure  RBM  in 
(7.1)  and  (7.2).  By  Theorem  7.2,  it  determines  the  limit  in  Theorem  1.1  for  0  <  a  <  1. 

Finally,  an  old  open  problem  is  the  limiting  behavior  of  the  stationary  departure  process 
from  n  queues  as  n  — »  oo.  Here  we  assume  that  the  service  times  V(i,  j )  are  i.i.d.  for  i  £  1 
and  j  £  2  while  the  service  times  V(i,  1)  are  i.i.d.  (or  just  stationary  and  ergodic)  with 
E  V(\,  1)  >  £  V(l,  2),  so  that  the  departure  process  from  the  first  queue  corresponds  to  an 
external  arrival  process  with  mean  interanival  time  greater  than  the  subsequence  mean  service 
times.  For  the  case  in  which  V(  1 , 2)  is  exponentially  distributed,  but  V(l,  1)  is  not,  it  is 
widely  believed  that  the  stationary  departure  process  from  queue  n  is  asymptotically  Poisson  as 
n  — »  oo.  A  corresponding  result  for  infinite-server  queues  was  established  by  Vere- 
Jones  (1968). 
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